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Abstract The aim of this research is to examine 
postgraduate theses on curriculum evaluation completed 
between the years 2006-2015 in Turkey in terms of various 
aspects such as university, year, curriculum which is 
evaluated, curriculum evaluation model, research method, 
design, sample type, data collection methods, data analysis 
technique. In order to determine the theses, a comprehensive 
review was made through the thesis database of Council of 
Higher Education (COHE). 306 postgraduate theses were 
used as data sources. Methodological structure 
determination form was used as data collection tool in this 
study. Content analysis, one of qualitative data analysis 
techniques, was used in the analysis of theses. Frequency and 
percentage values about the obtained themes were presented. 
In the study, it was seen that theses on curriculum evaluation 
were largely studied between 2009-2012, most of them were 
master thesis, mostly primary school curricula were 
evaluated, curriculum evaluation models weren’t used in the 
majority of the theses, mostly quantitative research methods 
and descriptive model was used, mostly survey and interview 
were used as data collection technique, data was collected 
from teachers and students in the majority of studies, one 
variable analyses and correlational analyses were mostly 
used as data analysis technique. In the light of results 
achieved, the more use of qualitative and mixed research 
methods, qualitative and experimental designs, all 
stakeholders as data sources, advanced statistical methods 
and the more evaluation of secondary and higher education 
curricula are recommended. 

Keywords Curriculum Evaluation, Curriculum 
Development, Postgraduate Education, Thesis, Dissertation 


1. Introduction 


The century in which we live is an era that has brought 
about great scientific and technological advances, one in 
which information multiplies, and the reality shapes in 
accordance with the spirit of time. In this context, institutions 
need to renew themselves and keep up with change in the age. 
Education systems and institutions also have important 
duties at the point of adapting and steering to developments. 
For this reason, all countries develop curricula for all levels 
of education to keep pace with these developments and to 
educate qualified individuals. However, it is a requirement 
for educators to evaluate curricula regularly in the light of the 
fact that curriculum development is a dynamic process while 
everything changes. 

It is necessary to evaluate curricula as an important 
operation of curriculum development [1] to make better 
decisions in the process of curriculum development [2], 
Curriculum evaluation is a decision-making process about 
the effectiveness of the curriculum [3]; the last and 
complementary operation of curriculum development 
process and evaluation presents the accession level of targets 
determined [4], With a comprehensive definition, curriculum 
evaluation is a decision-making process about the validity, 
appropriateness, efficiency, effectiveness, usefulness, 
success and executability of a developed curriculum by using 
scientific research processes [5]. It is important to ask right 
questions for right people to carry out curriculum evaluation 
effectively [6], Thus, feedback from the stakeholders 
concerned with the curriculum at all levels may be the basis 
for curriculum development [7]. From these definitions and 
explanations, it can be stated that curriculum evaluation has 
the following features: (i) Curriculum development and 
curriculum evaluation are interrelated processes, (ii) 
Different dimensions of a curriculum can be evaluated by 
virtue of curriculum evaluation, (iii) Scientific research 
methods are used in the process of curriculum evaluation, (iv) 
Data can be collected from different sources to evaluate a 
curriculum, (v) Generally, at the end of curriculum 
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evaluation process, a decision is made about the curriculum. 

Curriculum evaluation has important functions. 
Measuring and evaluating the learning outcomes of learners 
reveal how much progress they make, and their status within 
their peers by comparing with their peers. Another important 
function of the evaluation is to determine the value of the 
curriculum. The appropriateness of the objectives, whether 
the curriculum is implemented as intended or not, the 
appropriateness of the curriculum for students, the learning 
process, the appropriateness of content and teaching 
materials are revised with evaluation. The third important 
function of evaluation is to make a judgment about the value 
of all administrative regulations and practices [8]. In short, 
although there are different opinions about the purposes and 
functions of curriculum evaluation, the aim at the center of 
the evaluation is to determine the value of all or a part of the 
curriculum [9]. Determining the value of the curriculum 
helps decision-makers to decide about the future of the 
curriculum. 

Different types of evaluation are included in the literature, 
but the most cited classification is made by Scriven. Scriven 
states two types of evaluation in this classification: 
Formative evaluation and summative evaluation. Formative 
evaluation is a type of evaluation used in the development 
and implementation of the curriculum in general, and 
concentrating on behaviors of teachers and students, 
providing intensive feedback [10, 11]. On the other hand, 
summative evaluation is a type of evaluation concentrating 
whether the curriculum works or not, and examining the total 
effect of various components of the curriculum [9, 11]. 
Summative evaluation is applied after the curriculum was 
implemented and formative evaluation results are also used 
in this type of evaluation. 

There are different studies on the characteristics and 
orientations of educational researches in Turkey. Karadag 
[12] examined dissertations in the field of educational 
sciences; Ank & Turkmen [13], and Erdem [14] focused on 
the articles in educational sciences journals; Misirh & Kurt 
[15] examined computer based mathematics and geometry 
teaching studies; Adigiizel & Ergiinay [16] analyzed studies 
on values and values education; Sert et al. [17] investigated 
studies examining the use of technology by teachers, Kaytez 
& Durualp [18] studied postgraduate theses related to games 
in pre-school education. Flazir-Bikmaz et al. [19] analyzed 
dissertations completed between 1974 and 2009 in the field 
of Curriculum and Instruction and Kozikoglu & Senemoglu 
[20] analyzed dissertations completed between 2009 and 
2014 in the same field. It can be said that these studies 
present the pictures of different fields. When these studies 
are examined, the tendencies of the studies in a specific field 
are seen. 

Officials, nonprofit funders, oversight agencies, and 
citizens in every country want to learn the value of 
curriculum they funded. Stakeholders of curricula also want 
to know whether their curriculum is performing properly or 
not [21]. In Turkey, curriculum evaluation studies are 


generally carried out in two different ways. The first of these 
is curriculum evaluation studies conducted by Ministry of 
National Education (MONE) officially and the second is 
curriculum evaluation studies conducted by academicians 
and researchers at universities as dissertations, articles or 
oral presentations [22]. Gokmenoglu [23] examined the 
curriculum evaluation studies in Turkey in terms of models 
and approaches. Trends in curriculum evaluation studies in 
Turkey between 2004 and 2013 were examined in another 
study conducted by Kurt & Erdogan [24]. Nevertheless, 
there were no study revealing the tendencies of curriculum 
evaluation theses and dissertations having an important 
position in educational researches field. 

2. The Purpose and Importance of the 
Study 

The purpose of this research is to analyze theses (master 
theses and dissertations) on curriculum evaluation completed 
between the years 2006-2015 in Turkey in terms of various 
aspects such as years, universities, curriculum which is 
evaluated, curriculum evaluation models, research methods, 
designs, sample types, data collection methods, data analysis 
technique etc. This study will give the researchers in this 
field on how the planned studies should be done by analyzing 
the methodological tendencies in the curriculum evaluation 
studies. 

3. Method 

3.1. Research Design 

The qualitative research method was used in this study 
aiming the methodological examination of the curriculum 
evaluation theses completed between the years 2005-2014 in 
Turkey. Qualitative research is a method of natural and 
in-house researcher that serves as a means of collecting data 
[25], with the aim of in-depth description and interpretation. 
Despite the different patterns in qualitative research methods, 
this study is based on the design of the study case study 
because the situation of the curriculum evaluation studies in 
recent years is examined. Case study is a research design that 
focuses on understanding the current dynamics in an 
situation [26]. 

3.2. Data Source 

The data source of the research is composed of 306 
postgraduate theses on curriculum evaluation, which were 
completed between 2006-2015 and can be reached from the 
thesis database of Council of Fligher Education. 

3.3. Procedure 

The data collection process in the study is like that: (i) 
screening of curriculum evaluation theses, (ii) extraction of 
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inappropriate studies for the purpose of study, (Hi) coding of 
data, (iv) creation of themes, (v) identification and 
presentation of findings. 

An advanced screening was conducted at thesis database 
of Council of Higher Education (COHE) in order to 
determine the post-graduate theses to be included in the 
study. During the scan, the word (or words) to be searched 
are scanned by writing "curriculum evaluation" and selecting 
"All" in the search area. The theses were downloaded on 
computer in pdf format. Since all areas were screened at the 
first stage, it was seen that the studies that did not serve the 
purpose of the study were downloaded, too. In order to sort 
out these studies, the studies were reviewed and the studies 
that were not served for the purpose of studying were 
removed from the scope of the study. Attention has been paid 
to the fact that the studies included in the scope of the study 
reveal the current situation of a course, course or curriculum. 
Some of these curriculum evaluation studies focus on results 
and the others focus on judgements as said by Fitzpatrick et 
al. [9]. The determined studies are organized into folders 
according to the accepted years and they are examined one 
by one and the data are coded in the methodological 
structure determination form. This form was formed by 
researchers after searching the literature and taking the 
expert opinion. The process of coding has been carried out by 
combining the similar features and creating the 
themes/categories. For example, studies in which teacher 
education courses such as "curriculum development" and 
"planning and evaluation in teaching" were evaluated under 
"teacher education". Finally, the data that have been 
transformed into the themes are presented in tables. 


3.4. Analysis of Data 

In the analysis of the obtained data, the content analysis 
was applied to the qualitative data. Content analysis is an 
in-depth analysis technique aimed at reaching the concepts 
and correlations that explain the obtained data [25]. 
Twenty-five percent of post-graduate theses were randomly 
selected for reliability of the study. These selected studies are 
subject to content analysis and coded by the first researcher 
and another expert. The codification made by the coders was 
compared and tried to reach a consensus. Following this 
process, the reliability was calculated by using the Miles & 
Huberman [27] reliability formula (Reliability = Consensus / 
(Consensus + Dissidence), and the confidence level was 
found to be 94% as a result of the calculations. Therefore, it 
can be said that the results of the analysis in this study are 
reliable. 

4. Results 

The distribution of the theses in terms of completion year 
is presented in table 1. Out of 306 theses, 6 (1.96%) were 
completed in 2006, 15 (4.90%) in 2007, 14 (4.58%) in 2008, 
49 (16.01%) in 2009, 57 (18.63%) in 2010, 53 (17.32%) in 
2011, 46 (15.03%) in 2012, 28 (9.15%) in 2013, 21 (6.86%) 
in 2014 and 17 (5.56%) were completed in 2015. These 
findings show that most of curriculum evaluation studies 
were completed between 2009 and 2012. After 2012, the 
number of curriculum evaluation studies decreased. 


Table 1. The distribution of the theses in terms of completion year 
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Table 2. The distribution of the theses in terms of the type of thesis 


Master/Phd 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Master Thesis 

5 

11 

12 

42 

50 

37 

35 

17 

18 

9 

236 

77.12 

Dissertations 

i 

4 

2 

7 

7 

16 

11 

11 

3 

8 

70 

22.88 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100.00 


The distribution of theses in terms of the type of thesis is presented in the table 2. As seen in table 2, out of 306 studies, 236 
(77.12%) were completed as master thesis and 70 (22.88%) were completed as dissertations between the years 2006-2015. 
These results show that most of the theses were completed as master thesis. 
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Table 3. The distribution of the theses in terms of university 


University 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Gazi University 

0 

1 

1 

0 

7 

7 

8 

6 

2 

3 

35 

11.44 

Marmara University 

0 

0 

0 

1 

8 

4 

2 

2 

0 

0 

17 

5.56 

Abant t.B. University 

0 

0 

0 

3 

3 

3 

3 

2 

1 

1 

16 

5.23 

Atatiirk University 

1 

0 

1 

1 

2 

6 

2 

2 

0 

0 

15 

4.90 

Hacettepe University 

0 

3 

0 

4 

2 

1 

1 

0 

1 

2 

14 

4.58 

Ankara University 

1 

0 

0 

2 

1 

3 

2 

3 

0 

2 

14 

4.58 

Firat University 

1 

0 

1 

2 

4 

2 

0 

1 

0 

0 

11 

3.60 

KATU 

0 

0 

1 

5 

0 

4 

0 

1 

0 

0 

11 

3.60 

Q. 18 Mart University 

0 

1 

3 

1 

1 

2 

0 

0 

1 

1 

10 

3.27 

Qukurova University 

0 

3 

1 

2 

2 

2 

0 

0 

0 

0 

10 

3.27 

Erciyes University 

1 

0 

0 

3 

1 

3 

1 

0 

1 

0 

10 

3.27 

METU 

0 

0 

1 

3 

3 

0 

3 

0 

0 

0 

10 

3.27 

Selguk University 

1 

0 

1 

4 

1 

2 

0 

0 

0 

0 

9 

2.94 

Bahkesir University 

0 

0 

0 

1 

0 

3 

2 

1 

0 

1 

8 

2.61 

Sakarya University 

0 

1 

2 

2 

1 

1 

0 

0 

0 

0 

7 

2.29 

Kafkas University 

0 

0 

0 

1 

2 

1 

2 

1 

0 

0 

7 

2.29 

Uludag University 

1 

1 

0 

0 

0 

2 

1 

0 

2 

0 

7 

2.29 

Adnan M. University 

0 

0 

0 

2 

2 

0 

1 

0 

1 

0 

6 

1.96 

Anadolu University 

0 

1 

0 

1 

1 

0 

2 

0 

0 

1 

6 

1.96 

Mugla University 

0 

0 

1 

0 

2 

1 

0 

0 

1 

1 

6 

1.96 

Erzincan University 

0 

0 

0 

0 

2 

1 

1 

0 

1 

0 

5 

1.63 

Other Universities 

0 

4 

1 

10 

14 

5 

15 

9 

10 

5 

73 

23.86 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100.00 


Other Universities (Ege (r|= 4), inbnii (r|= 4), Afyon Kocatepe (q 2), Akdeniz (r)= 2), Beykent (r|= 1), Bahge§ehir (r|= 1), Bogazigi (r|= 1) Celal Bayar (r|= 
12, Cumhuriyet (r|= 2), f'ag (r|= 1), Dicle (r)= 3), Dokuz Eyliil (r|= 3), Dumlupmar (r|= 1), Eski$ehir Osmangazi (r|= 2), Gaziantep (r|=2), Gaziosmanpa§a (r|= 
1), Istanbul (r|= 1), Kahramanmara? Siitgii Imam (r|= 1), Kinkkale (r)= 1), Mehmet Akif Ersoy (r|= 2), Mersin (r|= 1), Mustafa Kemal (ri= 1), Necmettin 
Erbakan (r|= 3), Nigde (r|= 2), Ondokuz Mayis (r|= 2), Pamukkale (r|= 2), Suleyman Demirel (r|= 1), Trakya (r|= 4), Ufuk (r|= 2), U§ak (r)= 2), Yeditepe (r|= 
4), Yildiz Teknik (r|= 4), Yuziincu Yil (r|= 1), Zonguldak Karaelmas (r|= 2), Zirve (r|= 2)). 

The distribution of the theses in terms of universities is presented in table 3. The universities in which the highest number 
of the thesis and dissertations were completed are like that: Gazi University (r|=35), Marmara University (r|=17), Abant izzet 
Baysal University (r|=16), Atatiirk University (r|=15), Hacettepe University (t/= 14), Ankara University (//= 14), Firat 
University (//= 11), Karadeniz Technical University (t/= 11), Erciyes University (t/= 10), Middle East Technical University 
(r|=10), (,'ukurova University (t/= 10), (,'anakkale 18 Mart University (ij= 10). These findings indicate that curriculum 
evaluation studies were conducted in many universities in Turkey. 


Table 4. The distribution of the theses in terms of departments 


Department 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Educational Sciences 

4 

9 

7 

23 

25 

20 

23 

10 

10 

9 

140 

45.75 

Elementary/Primary Education 

1 

5 

4 

10 

13 

10 

8 

6 

4 

1 

62 

20.26 

ELT 

- 

- 

- 

3 

3 

1 

3 

2 

1 

4 

17 

5.56 

Secondary School Science and 
Mathematics Education 

- 

1 

- 

2 

3 

5 

1 

2 

2 

1 

17 

5.56 

Secondary School Social Studies 
Education 

- 

- 

1 

2 

1 

8 

- 

- 

1 

1 

14 

4.58 

Philosophy and Religious Studies 

1 

- 

- 

2 

2 

3 

- 

2 

2 

- 

12 

3.92 

Turkish Education 

- 

- 

1 

4 

1 

- 

4 

- 

- 

- 

10 

3.27 

Fine Arts Education 

- 

- 

- 

- 

4 

3 

3 

- 

- 

- 

10 

3.27 

Physical Education and Sports 

- 

- 

- 

2 

2 

- 

- 

1 

- 

- 

5 

1.63 

Lifelong Learning and Adult 
Education 

- 

- 

- 

- 

1 

- 

1 

- 

- 

- 

2 

0.65 

Computer and Instructional 
Technology Education 

- 

- 

- 

1 

- 

- 

- 

- 

1 

- 

2 

0.65 

Other Departments 

- 

- 

1 

- 

2 

3 

3 

5 

- 

1 

15 

7.67 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

20 

17 

306 

100.00 
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The distribution of the theses in terms of departments is like that: Educational Sciences (r|=140), Elementary/Primary 
Education (r|=62), ELT (r|=17), Secondary School Science and Mathematics Education (r|=17), Secondary School Social 
Studies Education (r|=14), Philosophy and Religious Studies (rj=12), Turkish Education (r|=10), Fine Arts Education (r|=10), 
Physical Education and Sports (r|=5), Lifelong Learning and Adult Education (r|=2), Computer and Instructional Technology 
Education (rp2), and Other Departments (rp 15). These findings show that most of curriculum evaluation theses were 
conducted in Educational Sciences and Elementary/Primary Education departments in Turkey. 


Table 5. The distribution of the theses in terms of evaluated curriculum 


Evaluated Curriculum 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Science and Technology 

- 

2 

3 

4 

7 

3 

3 

2 

1 

- 

25 

8.20 

Social Sciences 

1 

2 

4 

4 

3 

3 

2 

1 

3 

1 

24 

7.84 

Teacher Education 

- 

1 

2 

2 

3 

3 

5 

2 

2 

3 

23 

7.52 

English 

- 

- 

1 

4 

6 

2 

3 

- 

2 

2 

20 

6.54 

Elementary/Primary School 
Mathematics 

1 

3 

- 

5 

2 

3 

4 

1 

- 

- 

19 

6.21 

Turkish 

- 

- 

3 

4 

1 

1 

3 

- 

1 

2 

15 

4.90 

English Preparatory (University) 

- 

- 

- 

3 

3 

- 

2 

2 

- 

1 

11 

3.60 

Pre-School Education 

- 

- 

- 

3 

1 

1 

2 

2 

- 

- 

9 

2.94 

Religious Culture and Moral 
Knowledge 

1 

- 

- 

2 

1 

2 

- 

3 

- 

- 

9 

2.94 

Class Guidance 

- 

- 

- 

1 

1 

2 

3 

- 

1 

- 

8 

2.61 

Primary School Curricula 

1 

1 

- 

2 

3 

1 

- 

- 

- 

- 

8 

2.61 

Music 

- 

- 

- 

1 

1 

3 

1 

1 

- 

- 

7 

2.29 

Life Sciences 

- 

- 

- 

2 

1 

3 

- 

- 

- 

- 

6 

1.96 

Turkish Language and Literature 

- 

- 

- 

- 

1 

4 

- 

- 

- 

1 

6 

1.96 

Computer 

- 

- 

- 

1 

1 

1 

- 

- 

3 

- 

6 

1.96 

Geography 

- 

- 

- 

2 

1 

2 

- 

- 

- 

- 

5 

1.63 

Biology 

- 

- 

- 

1 

2 

- 

- 

1 

- 

1 

5 

1.63 

Physical Education 

- 

- 

- 

2 

1 

- 

- 

1 

1 

- 

5 

1.63 

Citizenship and Democracy 

- 

2 

- 

- 

- 

1 

1 

- 

- 

- 

4 

1.31 

Physics 

- 

- 

- 

- 

2 

1 

- 

- 

1 

- 

4 

1.31 

Technology and Design 

- 

- 

1 

- 

- 

1 

1 

- 

- 

- 

3 

0.98 

Visual Arts 

- 

- 

- 

1 

- 

2 

- 

- 

- 

- 

3 

0.98 

Secondary School Mathematics 

- 

- 

- 

- 

1 

1 

- 

- 

- 

- 

2 

0.65 

In-Service Teacher Education 

- 

- 

- 

- 

- 

- 

1 

- 

1 

- 

2 

0.65 

Chemistry 

- 

- 

- 

- 

- 

- 

1 

1 

- 

- 

2 

0.65 

Candidate Teacher 

- 

- 

- 

- 

1 

- 

1 

- 

- 

- 

2 

0.65 

Postgraduate Education 

- 

- 

- 

- 

- 

- 

- 

1 

- 

1 

2 

0.65 

Others 

2 

4 

- 

5 

14 

13 

13 

10 

5 

5 

71 

23.20 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100.00 


The distribution of the theses in terms of evaluated curricula is presented in table 5. The most evaluated curricula are like 
that: Science and Technology (rp25), Social Sciences (rp24), Teacher Education (r|=23), English (r|=20), 
Elementary/Primary School Mathematics (r|=l9), Turkish (r|=15), English Preparatory (University) (r|=ll), Pre-School 
Education (r|=9), Religious Culture and Moral Knowledge (r|=9), Class Guidance (r|=8), Primary School Education (r|=8), 
Music (r|=7), Life Sciences (r|=6), Turkish Language and Literature (r|=6), Computer (r|=6), Geography (r|=5), Biology 
(r|=5), Physical Education (r|=5). These findings show that elementary/primary school curricula were evaluated mostly. On 
the other hand, secondary school curricula were evaluated in Turkey. 


Table 6. The distribution of the theses in terms of research methods 


Method 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Quantitative 

3 

11 

9 

29 

30 

25 

21 

11 

11 

4 

154 

50.32 

Qualitative 

2 

3 

2 

7 

15 

16 

13 

8 

5 

2 

73 

23.86 

Mixed 

1 

1 

3 

13 

12 

12 

12 

9 

5 

11 

79 

25.82 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100,0 
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As seen in table 6, the distribution of the theses in terms of the research method is like that: The most used research method 
is quantitative method (q=54), followed by mixed method (q = 79) and qualitative (q=73) respectively. These findings show 
that quantitative method is used more than qualitative and mixed methods in curriculum evaluation theses in Turkey. 


Table 7. The distribution of the theses in terms of research designs 


Design 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Descriptive/Survey 

5 

11 

10 

42 

51 

34 

33 

16 

17 

14 

233 

76.14 

Experimental 

- 

2 

3 

3 

2 

5 

2 

3 

- 

- 

20 

6.54 

Case Study 

- 

- 

- 

1 

3 

4 

5 

3 

3 

1 

20 

6.54 

Phenomenology 

- 

- 

- 

- 

- 

1 

2 

1 

- 

1 

5 

1.63 

Mixed Research Designs 

- 

- 

- 

- 

- 

- 

- 

- 

1 

1 

2 

0.66 

Action Research 

- 

- 

- 

- 

1 

- 

- 

- 

- 

- 

1 

0.33 

No Design 

1 

2 

1 

3 

- 

9 

4 

5 

- 

- 

25 

8.17 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100,0 


As seen in table 7, The distribution of the theses in terms of research designs is like that: In most of the theses, 
survey/descriptive design (76.14%) was preferred, it is followed by experimental design (6.54%), case study design (6.54%), 
phenomenological design (1.63%), mixed research designs (0.66%) and action research design (0.33%) respectively. 
Research design wasn’t used in 25 (8.17%) theses. These findings show that most of curriculum evaluation studies carried out 
by using descriptive/survey design. 


Table 8. The distribution of the theses in terms of curriculum evaluation models 


Curriculum Evaluation Model 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

CIPP 

- 

- 

1 

2 

2 

1 

3 

1 

1 

1 

12 

3.92 

Countenance Model 

- 

- 

- 

- 

1 

- 

2 

- 

- 

- 

3 

0.98 

Objective Oriented Evaluation Model 

- 

- 

- 

- 

- 

- 

- 

1 

1 

1 

3 

0.98 

Educational Connoisseurship 
Criticism Model 

- 

- 

- 

1 

1 

- 

- 

- 

- 

- 

2 

0.65 

UCLA 

- 

- 

- 

- 

- 

- 

- 

- 

1 

- 

1 

0.33 

Analytic Curriculum Evaluation 
Model 

- 

- 

- 

- 

- 

- 

- 

- 

- 

1 

1 

0.33 

Discrepancy Evaluation Model 

- 

- 

- 

- 

- 

- 

1 

- 

- 

- 

1 

0.33 

Bellon and Handler Model 
(1982)-Brown (1989) Evaluation 
Model 

- 

- 

- 

1 

- 

- 

- 

- 

- 

- 

1 

0.33 

Objectives Oriented Model-Eisner’s 
Educational Connoisseurship 
Criticism Model 

- 

- 

- 

- 

- 

1 

- 

- 

- 

- 

1 

0.33 

No Model 

6 

15 

13 

45 

53 

51 

40 

26 

18 

14 

281 

91.83 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100.00 


The distribution of the theses in terms of curriculum evaluation models is presented in table 8. Out of 306 theses; 
curriculum evaluation models were not used in 281 (91.83%) thesis, Stufflebeam’s CIPP Evaluation Model was used in 12 
(3.92%), Stake’s Countenance Model was used in 3 (0.98%), Tyler’s Objective Oriented Evaluation Model was used in 3 
(0.98%), Eisner’s Educational Connoisseurship Criticism Model was used in 2 (0.65%), UCLA Evaluation Model was used 
in 1 (0.33%), Demirel’s Analytic Curriculum Evaluation Model was used in 1 (0.33%), Provus’s Discrepancy Evaluation 
Model was used in 1(0.33%), Bellon and Handler Model (1982) and Brown (1989) Evaluation Model were used in 1(0.33%) 
and Objectives Oriented Model and Eisner’s Educational Connoisseurship Criticism Model were used in 1 (0.33%). These 
findings indicate that curriculum evaluation models were not used in most of studies. 


Table 9. The distribution of the theses in terms of data collection techniques 


Data collection technique 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Survey 

3 

7 

10 

29 

33 

25 

23 

11 

10 

11 

162 

52.94 

Interview 

2 

4 

4 

16 

16 

16 

18 

14 

7 

13 

110 

35.95 

Scale 

1 

6 

5 

13 

10 

12 

7 

5 

5 

5 

69 

22.55 

Achievement Test 

- 

3 

3 

3 

2 

5 

6 

4 

1 

1 

28 

9.15 

Observation 

1 

1 

- 

6 

2 

4 

5 

1 

1 

2 

23 

7.52 

Document Analysis 

2 

1 

2 

3 

10 

12 

10 

5 

1 

1 

47 

13.73 
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As seen in the table 9, the distribution of the theses in terms of data collection techniques used in theses is like that: The 
most used techniques are survey used in 162 (52.94%) theses, interview in 110 (35.95%), scale in 69 (22.55%), achievement 
tests in 28 (9.15%), observation in 23 (7.52%), and document analysis in 47 (13.73%). These findings show that the most 
used quantitative data collection technique is the survey and the most used qualitative data collection technique is the 
interview. 


Table 10. The distribution of the theses in terms of the number of data collection techniques 


The number of data 
collection technique 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

One 

4 

12 

8 

34 

42 

36 

31 

16 

16 

6 

205 

66.99 

Two 

1 

1 

4 

10 

12 

13 

10 

11 

5 

8 

75 

24.51 

Three 

1 

1 

1 

4 

2 

3 

2 

1 

- 

1 

16 

8.50 

Four 

- 

- 

- 

1 

- 

1 

3 

- 

- 

2 

7 

2.29 

Five 

- 

1 

1 

- 

1 

- 

- 

- 

- 

- 

3 

0.98 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100.00 


As seen in the table 10, the distribution of the theses in terms of the number of data collection techniques is like that: one 
technique is used in 205 (66.99%), two techniques are used in 75 (24.51%), three techniques are used in 16 (8.50%), four 
techniques are used in 7 (2.29%) and five techniques are used in 3 (0.98%) theses. These findings show that one data 
collection tool was used in curriculum evaluation theses mostly. 


Table 11. The distribution of the theses in terms of data analysis techniques 


Data analysis techniques 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

One variable-correlational 

2 

10 

7 

25 

25 

24 

15 

12 

9 

1 

130 

42.48 

Qualitative 

1 

2 

2 

4 

11 

16 

11 

3 

4 

2 

56 

18.30 

One variable 

2 

2 

1 

9 

9 

2 

8 

2 

1 

3 

39 

12.75 

One 

variable-correlational-qualitative 

- 

1 

1 

5 

5 

6 

6 

3 

4 

8 

39 

12.75 

One variable-qualitative 

- 

- 

2 

4 

6 

4 

5 

3 

1 

3 

28 

9.15 

One variable-correlational 
-inferential 

- 

- 

- 

- 

- 

- 

- 

1 

1 

- 

2 

0.65 

One 

variable-correlational-qualitative- 

inferential 

- 

- 

1 

- 

- 

- 

- 

- 

- 

- 

1 

0.33 

inferential 

- 

- 

- 

- 

- 

1 

- 

- 

- 

- 

1 

0.33 

No analysis technique 

1 

- 

- 

2 

1 

- 

1 

4 

1 

- 

10 

3.27 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100.00 


As seen in the table 11, the distribution of the theses in terms of data analysis techniques used in theses is like that: One 
variable analyses-correlational analyses were used together in 130 (42.48%), qualitative analyses in 56 (18.30%), one 
variable analyses in 39 (12.75%), one variable-correlational analyses-qualitative analyses together in 39 (12.75%), one 
variable analyses- qualitative analyses in 28 (9.15%), one variable analyses-correlational analyses-inferential analyses 
together in 2 (0.65%), one variable analyses-correlational analyses-inferential analyses- qualitative analyses together in 1 
(0.33%), inferential analyses in 1 (0.33%), and data analysis techniques weren’t used in 10 (3.27%) theses. The mean of this 
data is that the most used data analysis technique is one variable-correlational technique. In other words, advanced data 
analysis techniques were less used. 

As seen in the table 12, the distribution of the theses in terms of data sources is like that: teachers were used in 184 (60.13%) 
theses, students in 116 (37.91%), academicians in 46 (15.03%), school administrators in 12 (3.92%), graduates in 6 (1.96%), 
parents in 3 (0.98%), inspector in 2 (0.65%) and other sources were used in 13 (4.25%) theses. In addition, no data sources 
were used in 37 (12.09%) of the theses. These findings show that teacher applying the curricula and students who are the 
target of curricula were used as data sources mostly. 
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Table 12. The distribution of the theses in terms of data sources 


Data sources 

Year 

Total 

(%) 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

Teacher 

2 

12 

10 

36 

33 

29 

21 

14 

13 

14 

184 

60.13 

Student 

2 

5 

3 

16 

19 

22 

21 

14 

5 

9 

116 

37.91 

Academician 

1 

2 

- 

7 

7 

5 

8 

8 

4 

4 

46 

15.03 

School administrator 

1 

1 

- 

1 

3 

- 

3 

- 

1 

2 

12 

3.92 

Graduate 

- 

- 

- 

1 

1 

1 

- 

- 

2 

1 

6 

1.96 

Parents 

- 

- 

- 

- 

2 

- 

1 

- 

- 

- 

3 

0.98 

Inspector 

- 

- 

- 

1 

- 

1 

- 

- 

- 

- 

2 

0.65 

Others 

1 

1 

- 

2 

1 

1 

4 

2 

- 

1 

13 

4.25 

No data sources 

2 

1 

1 

- 

11 

10 

7 

4 

1 

- 

37 

12.09 


Table 13. The distribution of the theses in terms of the number of data sources 


The number of data 

Year 

Total 

(%) 

sources 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

2015 

One 

2 

8 

13 

35 

29 

29 

24 

15 

16 

8 

179 

58.50 

Two 

1 

5 

- 

9 

14 

12 

10 

5 

2 

5 

63 

20.59 

Three 

1 

1 

- 

5 

2 

2 

5 

4 

2 

2 

24 

7.84 

Four 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

2 

0.65 

Five 

- 

- 

- 

- 

1 

- 

- 

- 

- 

- 

1 

0.33 

No data source 

2 

1 

1 

- 

11 

10 

7 

4 

1 

- 

37 

12.09 

Total 

6 

15 

14 

49 

57 

53 

46 

28 

21 

17 

306 

100.00 


As seen in the table 13, the distribution of the theses in 
terms of the number of data sources is like that: one source is 
used in 179 (58.50%), two sources are used in 63 (20.59%), 
three sources are used in 24 (7.84%), four sources are used in 
2 (0.65%) and five sources are used in 1 (0.33%) theses. Data 
sources were not used in 37 (12.09%) theses. These findings 
show that more than half of the studies were conducted by 
collecting data from only one stakeholder of curricula. 

5. Discussion 

It was aimed to examine curriculum evaluation theses 
made in Turkey between 2006-2015 in this study, and for this 
reason 306 theses were examined. It is seed that the theses 
covered in this study were conducted by researchers who did 
not have decision-making authority generally. This result is 
understandable, since theses were carried out by master and 
doktoral students who are independent researchers. On the 
other hand, the results of curriculum evaluation studies are 
meaningful when they effect the curriculum as Westbury [28] 
points out. Otherwise, curriculum evaluation studies can not 
go beyond providing literary contributions as theoretical and 
written texts. From this point of view, it can be said that the 
decision makers should be more involved in curriculum 
evaluation studies, and take into account the evaluation 
results in practice. Another result of this study is about the 
focus of researches. The focus of the studies was on results 


generally, and various judgments depending on the results 
were expressed. Regarding this issue, Fitzpatrick et al. [9] 
stated that the focus of some curriculum evaluation studies is 
on results and, in some cases, the focus is on 
curriculum-related j udgments. 

As a result of this study, it is seen that the number of 
curriculum evaluation theses increased between the years 
2009-2012, and after 2012 a considerable decrease has 
started in this issue. In the study conducted by Kurt & 
Erdogan [24], it was stated that the number of studies carried 
out after this date when the curriculum evaluation studies 
were completed mostly in 2010, is similar to the result of this 
study. It is clear that the reason of this increase between 2009 
and 2012 is the adoption of the constructivism in the primary 
school curricula in 2005-2006 academic year. The studies 
were started to evaluate these new curricula and continued 
for several years. Nevertheless, considering the fact that 
curriculum development is a dynamic process [3], the 
significant decline in the number of curriculum evaluation 
theses after 2012 is expressed as a problematic point. 

When the universities are examined, it is seen that these 
studies are done in many universities. Nevertheless, only 11 
of these universities appear to have received at least 10 
curriculum evaluation theses over a period of 10 years. When 
the departments are analyzed, it has been revealed that the 
theses are made in educational sciences and primary 
education departments. This is an expected outcome, as 
curriculum evaluation in Turkey is a major field of interest 
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for researchers in educational sciences department and 
primary school curricula were restuctured between the dates 
mentioned. Another result of the study is about curriculum 
selected to evaluate. Five main question should be ansvered 
in the process of selectin curriculum to evaluate [21]: Can 
the results of the evaluation influence decisions about the 
program? Can the evaluation can be done in time to be 
useful? Is the program significant enough to merit 
evaluation? Is program performance viewed as problematic? 
Where is the program in its development? When the theses 
were analyzed in terms of evaluated curricula, it is seen that 
primary school curricula restructered in 2005 were evaluated 
mostly between these dates. With this expected result, it can 
be said that secondary and higher education curricula should 
be more evaluated. 

In social sciences, quantitative research and qualitative 
research have some connotations. Quantitative research base 
on numbers, while qualitative research base on words and 
visual data. Morever, mixed method can be used in the 
evaluation of curricula. Quantitative and qualitative 
researches data collection instruments and data analysis 
techniques are used in this approach [21]. When the theses 
are examined in terms of applied research methods, it was 
found out that approximately half of the theses were of 
quantitative method, quartet of qualitative method and the 
remaining quartet of mixed method were used. This result 
shows that the tendency to use quantitative methods 
continues in researches, and in particular when the 
distributions of the theses in terms of the accepted years are 
examined, it is seen that the qualitative and mixed methods 
are being used more. Kurt & Erdogan [24], who achieved a 
consistent result with this result, explained this by the fact 
that quantitative researches offer more opportunities to 
access to people and that they are more economical in terms 
of duration and cost of implementation. When the 
distributions of the theses are examined in terms of research 
model/design, it is seen that the vast majority is realized in 
the descriptive/survey model. This result can be expressed as 
an understandable and expected result when it is thought that 
the curriculum evaluation is generally trying to reveal the 
situation of the applied curriculum. Nevertheless, it appears 
that the proportion of experimental designs should be applied, 
particularly at the point of determining program 
effectiveness, it remains low. Because the success of a 
curriculum is directly proportional to the degree to which it 
achieves its objectives. Therefore, qualitative and mixed 
designs as well as the experimental design should be 
included more in the curriculum evaluation studies to be 
carried out. 

Curriculum evaluation requires a systematic research 
process and can be used in a variety of curriculum evaluation 
models. Nevertheless, in most of the post-graduate education 
theses aimed at evaluating a curriculum in Turkey, the 
evaluation models were not used. This result is in agreement 
with the result of the work done by Gokmenoglu [23]. 
Gokmenoglu [23] explains that these end result studies are 


carried out in areas other than Educational Sciences, 
Curriculum Development, and Curriculum and Instruction 
Fields, which do not have sufficient theoretical background 
about curriculum evaluation, and that these studies are not 
includedcurriculum development experts as stakeholders. 
While this view reveals an important detail, it is seen that 
models are not taken as much basis in the evaluation studies 
made in the field of Educational Sciences in this study. In the 
studies using the model, it is seen that Stufflebeam's Context 
Input Process Product Evaluation Model (CIPP) is 
consistently consistent with the study done by Kozikoglu & 
Senemoglu [20] and Kurt & Erdogan [24]. It can be 
expressible that this model is at the point where it is desirable 
to offer comprehensive evaluation opportunities for curricula 
in various dimensions. 

Different data collection techniques having pros and cons 
can be used in the process of curriculum evaluation. The 
most common data collection techniques are paper and 
pencil questionnaires, computerized interfaces, interviews 
(face-to-face, telephone, focus groups). In addition, 
web-based techniques are used increasingly [29]. When the 
data collection techniques used in the curriculum evaluation 
theses are examined, it is seen that surveying/questionnaire is 
the first one from the quantitative data collection techniques, 
on the other hand, the interview from the qualitative data 
collection techniques is the foreground. Survey researches 
have advenced over the last 20 years, along with advances in 
tehnology and learning through expanded experiences. The 
number of surveying companies has increased considerably 
and surveying has become a massive industry. It is important 
doing a properly plan and pre-test the survey to provide valid, 
useful data about curriculum, and then cautiously check data 
collection and analytical processes [30]. When the number of 
data collection techniques is examined, it is seen that only 
one of the data collection techniques is used in the vast 
majority of studies. This result can be expressed as a lackness 
of the studies. Instead of using surveys in the evaluation of 
curriculum, it is necessary to use the scale, which is a more 
valid data collection tool, as well as the achievement tests to 
determine the extent to which the curriculum achieves its 
objectives. From the point of view of qualitative data 
collection techniques, it is necessary to use observation 
technique in curriculum evaluation studies, considering that 
the success of the curriculum in practice can be determined 
the best by observation technique. Observation can play an 
important role in curriculum evaluation, and it can provide 
data comparing the effects of differen curricula in different 
locations [31]. In addition, using only one data collection 
technique often does not provide enough rich data. Instead of 
this, the use of more than one data collection technique in a 
study enable more sophisticated and reliable data. 

Stakeholders of a curriculum are defined as individiuls, 
groups, and organizations that can affect or are affected by an 
curriculum evaluation process or its findings. This 
comprehensive definition includes many individuals and 
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groups. Key stakeholders who are the key of evaluation 
process are asubset group of this comprehensive group [32]. 
It is observed that the data was collected from teachers in 
more than half of the theses and this is followed by students 
and instructors. Kurt & Erdogan [24] stated that preparing 
the research problem for teachers and students and making it 
easier to collect data from these people can explain this 
situation. On the other hand, this result is understandable, 
since they are the key stakeholders of the education process. 
Moreover, in the data collection process, more than half of 
the theses were found to contain data from only one 
stakeholder. It is important collecting data from as many 
stakeholders as possible during the curriculum evaluation 
process, and it has an important function in terms of the 
reliability of the results of the evaluation and evaluation from 
different perspectives. Therefore, more data collection from 
other stakeholders (administrators, graduated, parents, etc.) 
should be considered as a recommendation that should be 
taken into consideration in the course of the curriculum 
evaluation studies, as well as teachers and students, as well 
as lecturers who are experts and serve for the purpose of the 
study. 

Statistics can be used in different ways in the process of 
quantitative data analysis. Statistical programs and 
contextual factors affect this diversity. Descriptive statistics 
(univariate statistics, and bivariate statistics), and inferential 
statistics can be used [33]. In this study, one variable and 
correlational data analysis techniques are used in nearly half 
of the theses as quantitative data analysis technique. This 
result is understandable, since curriculum evaluation studies 
are generally descriptive studies. Even so, it may be useful to 
use advanced/inferential statistical methods like structural 
equation model. On the other hand, it can be challenging to 
know how to analysis qualitative data, particularly for the 
evaluator like master and doctoral students. It can be advised 
a systematic framework (purpose, paradigms, options, 
interpretations, iterations, standards, ethics, displaying) for 
analyzing qualitative data [34]. In this study, it is found that 
especially descriptive analysis technique was used for 
analyzing qualitative data. Data was formed, thetematized, 
identifacated and interpretated in this technique [35]. 

6. Conclusions 

Curriculum evaluation is an important process for 
curricula and education systems. The studies investigated in 
this research focused more on results than judgements. When 
the studies analyzed methodological, the results showed that 
traditional research tendencies (quantitative research method, 
descriptive/survey design, teachers and students as data 
source, one variable and correlational data analysis 
techniques) still continues to be adopted. 
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